Extraction of work from a single thermal bath in the quantum regime 
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The stationary state of a quantum particle strongly coupled to a quantum thermal bath is known 
to be non-gibbsian, due to entanglement with the bath. For harmonic potentials, where the system 
can be described by effective temperatures, thermodynamic relations are shown to take a generalized 
Gibbsian form, that may violate the Clausius inequality. For the weakly-anharmonic case a Fokker- 
Planck type description is constructed. It is shown that then work can be extracted from the bath 
by cyclic variation of a parameter. These apparent violations of the second law are the consequence 
of quantum coherence in the presence of the slightly off-equilibrium nature of the bath. 
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The laws of thermodynamics are at the basis of our 
understanding of nature, so we all expect them to govern 
also systems coupled to a bath in the quantum regime. 
However, recently thought-provoking claims were made 
about a violation of Thomson's formulation of the sec- 
ond law (the impossibility to do work periodically with- 
out loosing heat) Q and even about a perpetuum mobile 
acting in an inhomogeneous superconducting ring 0] . 

Most of our thermodynamic understanding is based on 
the Gibbs distribution. The laws of equilibrium thermo- 
dynamics apply equally well to closed classical and quan- 
tum systems, as to open classical subsystems |3j. The set- 
ting for the classical case is well known: Under general 
statistical conditions |^-|(| one derives a Langevin equa- 
tion. The corresponding probability distribution is de- 
scribed by the Fokker-Planck equation, and it converges 
in time to the Gibbs distribution. 

Much less is known about the quantum Langevin equa- 
tion J3|,||,||-D ■ The stationary distribution has only been 
obtained for the harmonic potential. It depends explic- 
itly on the damping constant and becomes Gibbsian only 
in the limit of weak damping thus preventing the 

applicability of equilibrium thermodynamics. Entangle- 
ment is the very reason of this crucial difference, as sub- 
systems are necessarily in a mixed state. 

In the present paper we examine the standard model 
for quantum Brownian motion, the so-called Caldeira- 
Leggett model M, see eq. ([!]). Hereto we employ meth- 
ods developed recently for glasses . For a particle in 
harmonic potential we define effective temperatures, and 
put the thermodynamic relations in a generalized Gibb- 
sian form. For weakly anharmonic confining potentials 
Fokker-Planck equations will be constructed, which al- 
low to obtain the stationary distribution and elucidate 
important aspects of nonstationary properties. 

We shall provide a nontrivial thermodynamic interpre- 
tation for the relaxation towards the steady non-gibbsian 
state and for the slow change of a system parameter. Our 



main results are rather dramatic, apparently contradict- 
ing the second law: We show that the Clausius inequality 
d<2 < TdS can be violated, and that it is even possible 
to extract work from the bath by cyclic variations of a 
parameter ( "perpetuum mobile" ) . The physical cause for 
this appalling behavior will be traced back to quantum 
coherence in the presence of the near-equilibrium bath. 

The Quantum Langevin equation is derived from the 
exact Hamiltonian description of a particle and a ther- 
mal bath, when tracing out the degrees of freedom of the 
bath. For t < the particle and bath do not interact, 
and the whole system is described by a density matrix 
Pa = Pb ® Ps, where pb is the Gibbs distribution for the 
bath, and p s describes the state of the particle. At t = 
a linear coupling is switched on instantaneously, and the 
total Hamiltonian reads for t > flql 
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where p, pi, x, xi, and to, to^ are, respectively, the mo- 
mentum and coordinate operators and the masses of the 
particle and the modes of the bath. The latter have a 
constant frequency gap A, so u>i — i A. For the couplings 
we choose the Drude-Ullersma spectrum |p|,p|,pT| 
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where 7 is the damping constant, quantifying the stength 
of interaction, and T is the cut-off frequency of the inter- 
action with the bath. The thermodynamic limit is taken 
for the bath by sending A — > 0. Notice that this creates 
an infinite timescale 1/A, implying that in the remain- 
ing approach the limit of "large times" always means the 
state where time is still much less than 1/A. 

For fast switching on the interaction, an amount of 
work 
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Wo = tr{p o [W(0+) - W(O-)]} = ^tr( Ps x 2 ) (3) 

has to be supplied to the system. The large internal 
energy of the whole system U — (p 2 )o/2m + (V)q + 
ir 2 T 2 / (6hA)~l / A is increased by the finite amount Wo- 
This brings the system slightly out of equilibrium, since 
the von Neumann entropy tr(— polnpo) is exactly con- 
served under the switching. Notice that the switching 
energy Wo = ^jT(x 2 )o is purely a classical effect. 
The resulting quantum Langevin equation reads 

p+ — I dt'e-^-^pit') + V'(x) = V (t) (4) 



with Gaussian noise having (77) = and anticommutator 



K(t) 
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The connection between properties of the noise and the 
friction kernel is the consequence of quantum fluctuation- 
dissipation theorem [[||(| . Eq. (^) with physically suitable 
forms of the potential and friction describes a rich vari- 
ety of physical phenomena, such as Joscphson junctions 
p3| , ^4]| , processes in plasma and condensed matter [ |,pl[§ , 
interaction of atoms with black-body radiation p ] , and 
the Lamb shift of an electron ||] . 

We shall restrict ourselves to the quasi-Ohmic case, 
where T is much larger than other characteristic times. 
For i > 1/r we may expand the memory kernel in Eq. (0) 



r / df e- r <*-*V0 = p{t) # 
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Compared to the classical white noise case, one can thus 
adjust only the noise, see eq. (||), while keeping the fric- 
tion instantaneous. The same conclusion was reached in 
refs. Jl2|,[l5| for the exactly solvable harmonic potential. 

Work and heat. Let us explain the ingredients for the 
thermodynamic description of the Brownian particle hav- 
ing Hamiltonian H = p 2 /2m + V(x) and Wigner func- 
tion W[p, x, i). A change with time of the mean energy 
U = (H) = J dpdx WH is considered when slowly vary- 
ing a system parameter a, such as m or V"{0), according 
to a prescribed trajectory a{t): 



dU = d(H) = {HdlnW) + (dH) 



(7) 



The last term is the averaged mechanical work dW pro- 
duced by external sources [B 17 j. For a variation of an 
intrinsic parameter (for which dH — dTC), dW is the 
change of the total (particle+bath) mean energy. The 
first term in r.h.s. is due to the statistical redistribution 
of the phase space. We shall identify it with the change 
in heat dQ = (HdlnW), so Eq. (m) is just the first law. 

In the harmonic case V(x) — \ax 2 , Eqs. (|||3|) can be 
integrated directly, see e.g. P JT^ , pT] , p^[ | . In particular, 
the stationary Wigner distribution reads 



W s (p,x) 
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The effective temperatures T p and T x approach T in the 
classical limit, and have for large damping, 7 2 3> am the 
following values at T — > 0: 
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, T x = — — In — — (9) 
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The brownian particle has semiclassical behavior due to 
its interaction with the bath, and entropy S — S p + S x 
with S p = ^InemTp/h, S x = ^lneT x /ah. 

For an adiabatic variation of a parameter a the situa- 
tion is still described by Eq. (||) with a — a(t). One can 
check for U and the free energy F = U — T p S p — T X S X 

dU = dQ ad +dW ad = TpdSp + T x dS x +dW Qrf , (10) 
dF = ~S x dT x - S p dTp+dWa d . (11) 

These generalized thermodynamical relations are in close 
analogy with those proposed for glassy systems |l(| . 

To demonstrate a violation of the fundamental Clau- 
sius inequality dQ < TdS we consider a slow variation of 
the mass m at T — * 0. Using Eqs. (|[ ^|, |l0|) one gets 

dm „ h'y dm 

dw ad = -t p —, dQ ad = dU -dW ad = ^±2— (12) 
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Thus, there is the transfer of heat even for T = 0, and 
the Clausius inequality is violated when dQ > 0, i.e. for 
dm > 0. The latter also happens when varying a. 

The Fokker-Planck equation. Except for the solvable 
harmonic potential, Eq. (^) is hardly tractable. An- 
other approach having started from (||), goes further 
to the weak-coupling (small 7) limit described by a 
Markovian master-equation Q. In the opposite, strong- 
coupling limit one can consider the terms in (|I|) as c- 
numbers, but with the Gaussian quantum noise |13| . |l4| . 
The correspondence with the underlying quantum prob- 
lem is established through the Wigner function, i.e., 
(S(p(t) —p)S(x(t) — x)) = W(p, x, t). Since this approach 
is still exact for the harmonic case, one of the conditions 
of its validity involves a characteristic scale L where the 
non-linearity remains small: L 3> y/Kp) |l3|| . Based on 
this condition we have derived a closed equation for the 
Wigner function. Here we only give the final result, while 
details will be presented elsewhere , 



m dx dp V m 
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dW(x,p,t) _ p dW t d ^7 
dt 

d 2 d 2 W 
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For our purposes it is enough to indicate the stationary 
values of the diffusion coefficients D xp and D pp , 
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Dpp (x) 
Dxp (x) 



do; 
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Trm 2 {tjj 2 + lo 2 ){lo 2 + uj 2 ) 
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where K(ui) is the spectrum of K{t) in Eq. (|5|) and 
uoi.2 = [7± a/7 2 -4mV™(x)]/(2m). Equation Q was 
derived under the same assumptions as the semiclassical 
Langevin equation itself. For ensuring the convergence of 
the diffusion coefficients (Re(wi j 2) > 0) we will demand 
V" > (local stability). In the classical limit: D xp — > 0, 
Dpp T, and Eq. (|l3|) tends to usual Fokker-Planck 
equation |J|ll]]. For the harmonic case D xp and D pp be- 
come space-independent, and Eq. ( |l3| ) is in agreement 
with previous results |l^|ll],[l5| , obtained for a more gen- 
eral type of the environment. 

In the physically interesting case of overdamped mo- 
tion, where the characteristic times of the momenta 
to/7 and coordinate ^/V"{x) are widely separated 
7/V"(a;) 3> to/7, a solution of the Fokker-Planck equa- 
tion for t 3> m/7 can be presented as 



W(p,a;,t) 



exp[-p 2 /(2mD pp (a:, t))] 



W(x,t) (15) 



yj2innDpp{x, t) 
Here VF(x,f) is the solution of a reduced equation 

J = - V(x)W(x,t) - -^-[^(x, t)IF(x, i)], 
7 7 ax 

£>(x, t) = D xp (x, t) + D P p(x 7 t). 



(16) 
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It still contains the inhomogeneous, time-dependent dif- 
fusion coefficient. As we discussed, large, but finite 
r 3> U!%,2 is necessary only for the statistics of the mo- 
menta, see Eq. (ft). Taking r — > 00 in Eq. (p~8h we obtain 



D(x) 
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In the stationary state one has J(x) 
for the corresponding distribution 



0, which implies 



-PV e (x) 



V e (x) — T / dy 



V'( y) + D'(y) 
D(y) 



(20) 



where V e is an effective potential V e . Notice that W s (x) 
is non-gibbsian. For the harmonic potential Eq. (||) is 
recovered from this expression while the classical Gibbs 
distribution appears in the limit Ti(3 — * 0. Eqs. ( fl5| |20| ) 
show that the statistics of momenta is influenced by the 
coordinate, yielding its non-Maxwellian form. 

In classical case universal (thermodynamical) proper- 
ties of the relaxation are described by an H-theorem, 
which is intimately connected with a formulation of the 
second law [ppl] . This theorem can be generalized in our 



case, at least for times t ^> 771/7, where the momenta 
already came to the local equilibrium, and the relevant 
variable is x. The TL- function is defined as MM 



TL = J dxWi(x,t) In 
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where Wi^(x,t) are solutions of Eq. (16) correspond- 
ing to different initial conditions. Calculating TL from 
Eq. (Jlq) one performs partial integrations to obtain 



TL 



1 



dxWi(x,t)D(x,t) 



d u Wi(x,t) 
dx U W 2 (x,t) 



(22) 



Since D(x,t) > 0, TL is a monotonically decreasing func- 
tion, and attains its minimum in the stationary state [g] . 
On the other hand, TL is limited from below by zero, so we 
conclude that all solutions of the Fokker-Planck equation 
( |l6| ) converge with time to the stationary solution. Let 
us define the current-less state W s (x,t), obtained from 
W s (x) by the substitution D(x) — > D(x,t). Starting from 
Eq. (P2[ ) one can show that the entropy of the coordinate 
sector obeys 



dS x 
dt 



dxW(x,t) ]nW(x,t) 



d e S x diS x 

dt ~dT 
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Here the quantity 

de'S'a- 



dt 



dxVF(x,i)ln 



W s (x,t) 



dx J{x)pVl{x,t) 



can be interpreted as the flux of entropy. Indeed, J(x) 
is the probability current and — /9V/ represents a force 
divided by temperature. The second term in (p3[), 



d t S x 
dt 



dxW(x,t)D(x,t) 



d W(x,t) 
dx n W s (x,t) 
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is the entropy production during the relaxation. This 
quantity is strictly positive out of the steady state, and 
becomes zero in the long-time limit. In the classical 
case Eq. (^3|) leads to the well-known relation TdS — 
dQ+TdiS, since W s (x, t) becomes time-independent and 
coincides with the Gibbs distribution. However, in the 
general quantum case the relation between heat (dQ) and 
the flux of the statistical entropy (dQ = Td e S) appears to 
be broken. A similar relation can, though, still be recov- 
ered in the harmonic case, where the diffusion constant 
D does not depend on the coordinate. Applying Eq. fl23| ) 
we find T p dS p + T x dS x = dll +dn, where T p (t) — D pp (t) 
and T x (t) — D(t) are the time-dependent effective tem- 
peratures, anddn = T x diS x > is the energy dissipated 
during the relaxation. 

Returning to the case of varying a system parameter, 
we are now interested in the first non-adiabatic correc- 
tion to the stationary distribution, arising when the time 
of the variation is large, but finite. Since the dynamics 
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is in the overdamped regime, the main correction comes 
from the deviation of W(x, t) (and not the full W(p, x, t)) 
from its stationary form. The variation starts at t = U 
(the particle already reached its stationary state), and 
ends at t — tf. We shall assume a "smooth" start of the 
variation, i.e., a(U) = 0. It can be checked directly from 
Eq. (Rq) that W now reads for small a 



W(x,t) = W s (x,a) 
B(x,t) 



l + ^a(B(x,t)-(B)) 



_ OQ D{y,a)W s {y,a) W da 



A(y,f)= I dzW s (z,a)(f(z)-(f)), 
'v 



(24) 
(25) 
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where a = a(t) and the average is taken w.r.t. W s (x, a). 
The work finally becomes dW = SW a( i + cHI, with 



SW ad = adt J dxdpW s (p, x, a) 



dn 
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dH(p, x, a) 
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dx A(x,d a V)A(x,d a V e ) 
D(x, a)W s (x, a) 
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In the Gibbsian case at large T, where V e — > V, one re- 
covers Wad = U — TS and the known result for dll > 
For low T 311 remains finite due to the explicit fac- 
tor T in V e , see ( p0| ) . We stress that dll is always relevant 
for cyclic processes a{ti) = a(tf), where AW ad = 0. 

In the harmonic case a can stand for the spring con- 
stant a. It is then straightforward to see that dll ~ 
d(a/T x )/da. As expected, this is always positive. 

For the oscillator with V(x) — ax 2 /2 + gx 4 /12 with 
small g the anharmonicity is displayed at the scale 
L = yj a i 1 9 ^ (W)- We shall now investigate the non- 
adiabatic correction to the work caused by temporal vari- 
ation of L. For T — > we additionally take the limit of 
large 7 in Eqs. (fH H), which yields 



An W-theorem is formulated in eqs. (f22|), (|23|)- For the 
harmonic potential generalized Gibbsian relations can be 
constructed in terms of effective temperatures (j|), (^|), as 
happens also in glassy systems JToj . Two formulations of 
the second law, namely the Clausius inequality and the 
impossibility to extract work during cyclical variations, 
can be apparently violated at low temperatures. One 
could thus speak of a "perpetuum mobile of the second 
kind" . We should mention, however, that the number of 
cycles can be large, but not arbitrarily large. As a result, 
the total amount of extractable work is modest (l6| . 

These violations of the second law are due to quantum 
coherence in the presence of the slightly off-equilibrium 
nature of the bath. We call them apparent violations, 
since, the standard requirements for a thermal bath not 
being fulfilled, thermodynamics just does not apply. Let 
us stress that also in the classical regime the harmonic 
oscillator bath is not in full equilibrium, but there the 
Gibbs distribution saves the day and thermodynamics 
does apply. Our results thus make clear that the charac- 
terization of the heat bath should be given with care. If 
it thermalizes on a short timescale, standard thermody- 
namics always applies. If it does not thermalize within 
the observation time, it acts as a "mechanical" part of 
the system, and thermodynamics need not have a say. 
Although it still applies in the classical case, we have 
discussed that it fails to do so in the quantum case. 

Let us close by noting that in the harmonic case the 
unequal effective temperatures do not cause heat currents 
that equalize them. This situation is reminiscent of the 
classical paradox that atoms should radiate, but, being 
in the quantum regime, they do not. 

We thank H. Dekker for useful discussions. A.E. A is 
grateful for support by FOM (The Netherlands). 
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Although 8lV(x) = — [a/(6L 3 )]x 4 is negative, di,V e {x) 
+ [jwT / (6hL 3 In 7)] x A is positive. Therefore dll is nega- 
tive. For small g we may calculate the integral in Eq. (|2~~ 
in the harmonic approximation, to get 
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where (x 2 ) = (2hlnj)/(wj) is the dispersion in this ap- 
proximation. The possibility to extract this energy from 
the bath is due to its non-equilibrium state, which is en- 
sured by the energy (|^) supplied in the switching. 

In conclusion, we have considered a brownian quan- 
tum particle strongly interacting with a quantum thermal 
bath. The non-gibbsian statistics of the particle is com- 
pletely described by Fokker-Planck equations (O, 16). 
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